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/-onnider ' an  M/G/k  queueing  model  having 
In  this  PaPeJ^C°n8^*t^ia,  a model  in  which  customers, 
finite  capacity  h • ™a  „ Poisson  process  having  rate 
arriving  in  accordance  with  a ^^less^than  N others 
:/*  > , enter  the  system  it  th  * then  serviced  by  one  of  k 

present  when  they  arrive,  * distribution  G . Upon 

servers,  each  of  whom  a immediately  enter  service 

entering,  a customer  will  f^^fe  join  the  queue  if  all 
if  at  least  one  server  is  free  or  e J dent  of  the 

servers  are  busy.  Our  results  wiH^be.i^  ^ ^ ^ l8 
order  of  service  of  ^0**aneve®  re^in  idle  if  customers 
supposed  that  a 8®rv  th  analysis,  however,  w*-w4rHr% 

^^^urvlce  discipline  of  ("first  come  first  to  enter 

service.  ' 
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A P P ROX I MAT IONS  IN  FINITE  CAPACITY 
MULT I -SERVER  QUEUES  WITH  POISSON  ARRIVALS 

by 

Shirley  A.  Nozaki  and  Sheldon  M.  Ross 

0.  INTRODUCTION 

In  this  paper,  we  consider  an  M/G/k  queueing  model  having  finite 
capacity  N . That  is,  a model  in  which  customers,  arriving  in  accordance 
with  a Poisson  process  having  rate  \ , enter  the  system  if  there  are  less 
than  N others  present  when  they  arrive,  and  are  then  serviced  by  one  of 
k servers,  each  of  whom  has  service  distribution  G . Upon  entering,  a 
customer  will  either  immediately  enter  service  if  at  least  one  server  is 
free  or  else  join  the  queue  if  all  servers  are  busy.  Our  results  will  be 
independent  of  the  order  of  service  of  those  waiting  in  queue  as  long  as  it 
is  supposed  that  a server  will  never  remain  idle  if  customers  are  waiting. 
To  facilitate  the  analysis,  however,  we  will  suppose  a service  discipline 
of  "first  come  first  to  enter  service." 

Our  objective  is  to  obtain  an  approximation  for  the  average  time  spent 
waiting  in  queue  by  an  entering  customer.  This  is  done  mainly  by  means  of 
an  approximation  assumption,  presented  in  Section  2,  and  used  in  Section  3 
to  derive  the  approximation.  In  Section  4,  we  let  N » ® and  relate  the 
approximation  to  the  existing  literature. 


1.  BASIC  DEFINITIONS  AND  FUNDAMENTAL  EQUATION 


We  shall  need  the  following  notation: 


‘Q 

v 


V 

e 


the  steady  state  probability  that  there  are  i people  in  the 
system. 

a service  time  random  variable,  i.e.,  P{S  x)  ■ G(x)  . 
the  average  amount  of  time  that  an  entering  customer  spends 
waiting  in  queue  (does  not  include  service  time), 
the  (time)  average  number  of  customers  waiting  in  queue, 
the  (time)  average  amount  of  work  in  the  system,  where  the  work 
in  the  system  at  any  time  is  defined  to  be  the  total  (of  all 
servers)  amount  of  service  time  necessary  to  empty  the  system  of 
all  those  presently  either  being  served  or  waiting  in  queue, 
the  average  amount  of  work  as  seen  by  an  entering  arrival. 


We  will  make  use  of  the  following  idea  (previously  exploited  in  such 
papers  as  [1],  [2]  and  [3])  that  if  a (possibly  flctltional)  cost  structure 
is  imposed,  so  that  entering  customers  are  forced  to  pay  money  (according 
to  some  rule)  to  the  system,  then  the  following  identity  holds — namely, 

time  average  rate  at  which  the  svstern  earns  - average  arrival  rate 

(1) 

of  entering  customers  * average  amount  paid  by  an  entering  customer. 

A heuristic  proof  of  the  above  is  that  both  sides  of  (1)  times  T is 
approximately  equal  to  the  total  amount  of  money  paid  to  the  system  by  time 

4* 

T , and  the  result  follows  by  dividing  by  T and  then  letting  T -*•  » . 


A rigorous  proof  along  these  lines  can  easily  be  established  in  the  models 
we  consider  since  all  have  regeneration  points.  More  general  conditions 
under  which  it  is  true  are  presented  in  [1], 
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Hv  choosing  appropriate  cost  rules,  many  useful  formulae  can  be 
obtuineu  us  special  cases  of  (1).  For  instance,  by  supposing  that  each 
customer  pays  $1  per  unit  time  while  in  service,  Equation  (1)  yields  that 

average  number  in  service  ■ '(1  - P^)E|S]  . 

Similarly,  by  supposing  that  each  customer  pays  $1  per  unit  time  while 
waiting  in  queue,  we  obtain  from  (1)  that 

LQ  ■ U1  - Vun  • 

Also,  if  we  suppose  that  each  customer  in  the  system  pays  $x  per  unit  time 
whenever  its  remaining  service  times  is  x , then  (1)  yields  that 


where  is  a random  variable  representing  the  (limiting)  amount  of  time 

that  the  nC^  entering  customer  spends  waiting  in  queue. 

Another  important  fact  which  we  shall  use  is  that,  since  our  arrival 
stream  of  customers  is  a Poisson  process,  the  probability  structure  of  what 
an  arrival  observes  is  identical  to  the  steady  state  probability  structure 


of  the  system. 


2.  1 UK  AIM’KOXIMAHON  ASSl'Ml’TlON 


Lot  G i denote  tlu*  oijut  1 ibr turn  distribution  oi  C . l'hat  Is, 


A 

i:  (x>  - f 
Vx’  J Ms] 


also  lot 


Mx,y) 


1 if  x - v 


It  x i v 


Wo  assume  throughout  that  ^xdC  (x)  - E(S“]/JE(S]  is  finite.  Wo  make  the 


following  approximat ion  assumption. 


Approximat Ion  Assumption: 


Given  that  a customer  urrlves  to  find  i busy  servers,  1 s 0 , then 
at  the  time  that  he  enters  service,  the  remaining  service  times  of  the 
other  i - jfi.k)  customers  being  served  has  a joint  distribution  that  Is 
approximately  that  of  independent  random  variables  each  having  distribution 


Heuristic  Remarks  Concerning  the  A. A.  : 


1.  In  the  infinite  capacity  case,  the  A. A.  appears  to  be  approximately 
true  either  in  heavy  traffic  (.that  is,  as  \ E [ S ] ■*  k)  or  in  light 
traffic  itluit  is,  as  \E[S]  * 0)  . This  is  so  in  heavy  traffic 
since  the  great  majority  of  arrivals  will  encounter  a large  queue 
and  as  a result  the  k departure  processes  lone  for  each  server j 


they  observe  will  be  approximately  Independent  delayed  renewal  pro- 
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cesses-  Hence,  considering  those  customers  served  by  server  1 , 

U follows  that  when  they  enter  service  the,  would  have  been 
observing  k - 1 Independent  delayed  renewal  processes  for  a 
large  time,  and  the  A.A.  follow,  since  the  limiting  distribution 

of  excess  in  a renewal  process  is  just  Gg 

in  extremely  light  traffic,  the  great  majority  of  arrival, 
will  find  either  0 or  1 busy  servers.  How,  since  Poisson 
arrivals  see  the  system  as  It  1.  (averaged  over  all  time) , It 
follows  that  arrivals  finding  1 server  busy  would  encounter  the 
same  additional  service  time  (for  the  busy  server)  es  would  random 
(and  uniform)  time  sampling  of  the  excess  of  s renewal  process. 
Hence,  the  A.A.  follows  In  light  traffic  from  the  renewal  process 

(excess)  result. 

Additional  heuristics  for  the  A.A.  follows  from  the  fact  that  it 
is  known  to  be  (exactly)  true  when  no  gueue  is  allowed  (see  (9,). 
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j.  THE  APPROXIMATION 

Since  V Is  the  average  amount  of  work  as  seen  by  an  arrival,  it 
follows  by  conditioning  upon  whether  or  not  an  arrival  enters  the  system 
that 


V ■ (1  - P.,)V  + P..  * (average  work  as  seen  by  a lost  customer). 

N e N 


In  accordance  with  our  basic  A. A. , it  sorms  reasonable  to  approximate  the 

£[S^1 

average  work  as  seen  by  a lost  customer  by  k j + (N  - k)E[S]  . Hence, 
we  have  that 


(3) 


V : (1  - pN)ve  + pN(k  fifjj  + «J  - k)E[si)  . 


Now  for  any  arbitrary  customer  that  enters  the  system  we  have  the  following 
identity 

work  as  seen  by  the  entering  customer  * 
k * time  entering  customer  spends  waiting  in  queue  + R 

where  R is  defined  to  be  the  sum  of  the  remaining  service  times  of  those 
being  served  when  the  customer  enters  service.  Taking  expectations  yields 
that 


(4)  Ve  - kWQ  + E[R]  . 


To  obtain  E[R]  , we  condition  on  , the  number  of  servers  that  are 


busy  when  the  customer  enters  the  system: 


’1 


t:  l K ! - E i E l R H 1) 

1* 


K|B  - 'IB  , k>  j -v^prf  bv  the  A. A. 
e «-*  -MM 


Ml  - P > E [Sj  ■ average  number  of  busy  servers  as  seen  bv  an  arrival 
N 

- (1  - P., ) F I B ] + kP  . 

N e N 


Also, 


E[i(Be.k)]-  (l-P N -V  -V 


and  so  from  (3)- (7)  and  Equation  (-)  we  obtain  that 


ELS..l  /^_p  _ V p \ - k)P  E[S] 

. 2E[S]  y N ;Q  lif  ^ N 1 1 


(1  - P ) Ik  - \E(SP 


Therefore,  it  remains  to  obtain  P^  and  P , 0 ^ J ^ k - 1 . To  do 
so,  we  impose  the  following  fictitional  cost  structure — namely,  that  the  i 
oldest  customers  in  the  system  pay  $1  per  unit  time,  l ■ 1,2,  ....  k , 
where  the  age  of  a customer  is  measured  from  the  moment  it  enters  the 
system.  Hence,  letting  S^,S*,  ....  denote  k - 1 independent 

random  variables  each  having  distribution  il  , we  obtain  from  Equation  (13 


m 


i 


8 


■ 


?l  ♦ 2P2  + ...  + (i  - 1)P1_1  + i(l  - PQ  - ...  - Pi_1) 


+ XPi+lE 


X(PQ  + ...  + Pi_1)E[S]  + AP^S  - min  (s®,S® S®))  J 

- 2nd  smallest  of  (s® Si+l))  j 


(9)  . 


+ AP, 


_2E^(s  - (k  - 1 - i)th  smallest  of  (s®,  ....  S®_2))  J 
+ A(1  - PN  - PQ  - ...  - Pk_2)E[(s  “ <k  - Dth  smallest  of  (s® S*^))  J 


i - 1,  ....  k - 1 


Px  + 2P2  + ...  + (k  - l)Pk_1  + k(l  - PQ  - ...  - - A(1  - Pn)E[S] 


(where  x*  - j*  " 

\ (0  if  x < 0/ 


To»  understand  the  above  equations,  suppose 


first  that  i < k . Now,  as  only  the  i oldest  pay,  it  follows  that  when 


j customers  are  present  the  system  earns  at  a rate  j when  j ^ i and  at 


a rate  i when  j > i . Hence,  the  left  side  of  Equation  (9)  represents 


the  average  rate  at  which  the  system  earns.  On  the  other  hand,  an  arrival 


finding  fewer  than  i customers  already  in  the  system  will  immediately  go 


into  service  and  will  pay  a total  amount  equal  to  his  service  time;  while 


an  arrival  finding  j present,  k-  1 > J > i will  also  go  immediately 


into  service  but  will  only  begin  paying  when  j - i + 1 of  the  j others 


in  service  leave.  Thus,  in  this  latter  case,  under  the  A. A. , the  arrival 


would  expect  to  pay  a total  of  E 


js- 


(j  + 1 - i)th  smallest  of 


^S®,S®,  ...,  S® j j . Finally,  if  the  arrival  found  more  than  k - 2 busy 


servers,  thou  ho  will  begin  paying  at  tor  k - 1 of  those  customers  in 
service  when  ho  enters  service  leave  the  svstom.  This  explains  the  first 
k - t of  the  set  of  Equation  (M).  The  last  equation  (when  i - k)  easily 
follows  since  in  this  case  each  customer  will  pav  a total  equal  to  his  time 
In  service. 

To  simplify  the  set  of  Equation  (Ml,  we  will  need  the  following  lemma. 


l.emma  1 : 


f 4* 

If  S,Sj,  ...,  are  Independent  random  variables  such  that  S has 

distribution  cl  and  the  others  cl  , then 

e 

E^S  - Jth  smallest  of  |s*,  ....  ^ E[S]  , 


Proof : 


Using  the  identity  (x  - v)  • x - min  (x,y)  , we  have  that 

[*/  e e \+l 

EllS  - Jth  smallest  of  S^,  ...,  Si  I ■ 

E[S|  - E^min  |s  , Jth  smallest  of  S*,  ...,  S^|j  . 


E^raln  |s  , Jth  smallest  of  S*,  .... 

«v 

■ j P(S  * alP-jjth  snuillest  of  • •••  ' a|da 
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K(S  1 


- E(S] 


r-  l 


dy 


- ElS] 


J 

r + 1 


which  proven  the  lemma. ■ 

It  follows  from  Lemma  1 that  the  equations  for  P^  and  P , 

0 J ^ k - 1 depend  on  (1  only  through  E[S]  . Hence,  as  the  equations 
are  exactly  true  when  C is  exponential,  it  follows  (since  for  fixed  , 
it  can  be  shown  that  the  set  of  equations  has  at  most  one  solution)  that 
the  Pj  , 0 J k - 1 have  the  same  relationship  to  P^  as  when  C.  is 
exponential.  Thus,  we  are  left  to  determine  P^  , which  we  will  approximate 
by  the  answer  in  the  exponential  case.  In  other  words,  we  shall  use  the 
exact  result  for  Pj»0^.Jl^-l,PN  when  C is  exponential  as  our 
approximation.  This  yields,  from  Equation  (8),  that 


(10') 


U£1 

2 E [ S ] 

Vl 

v . 

J-o 


1"k  k!kJ~k 

(*E[S1>J  + Nyl 
J • 


(N  - k) 

C\ELS])J 

L.  * 


E[S) (\E[S1)N 
. ,,  N-k 


(k  - \E| S ] ) 


Some  remarks  are  In  order: 


1.  In  [A],  Kingman  obtained  bounds  on  for  the  general  queueing 

system  CI/G/k.  When  adapted  to  the  M/G/k  case  of  Poisson  arrivals 
his  inequalities  are 


> ■)  ■»  i 


It  is  easily  verified  that  our  approximation  for  is  con- 

sistent with  Kingman's  upper  and  lower  bounds. 

. In  (5),  Kingman  conjectured  a heavy  traffic  approximat ion  for 
in  GI/G/k  models.  In  the  special  case  of  Poisson  arrivals,  his 
conlecture  is  that 


w 3,  O-LO 

Q J\k(k  - \E(s)) 


when 


\E[S)  % k . 


Calling  the  right  side  of  the  above  K and  our  approximation,  as 
given  by  (8),  N - K , we  have 
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K 

N - R 


iilSi 


PkE[SZI 


where  P ■ 1 - l P . Hence,  since  in  heavy  traffic, 

R 0 J 

E [ S 1 % k/X  , P « 1 , we  see  that  our  approxioation  is  consistent 
with  Kingman's  heavy  traffic  conjecture. 

3.  Numerical  cables  for  Lq  have  been  published  by  Hillier  and  Lo 

in  the  special  case  M/E^/k,  where  E^  represents  an  Erlang 
distribution  with  r phases.  Table  1 compares  our  approximate 
formula  for  (*  XW^)  with  the  Hillier-Lo  tables. 

4.  Another  heavy  traffic  conjecture  was  given  by  Maaloe  who  in  [6] 
conjectured  that  for  the  model  M/E^/k 


WQ  * 2k(k-SXE[S]T  When  XE[S]  * k ' 


As  the  ratio  between  our  approximation  and  the  above  approaches 
unity  in  heavy  traffic,  we  see  that  our  approximation  is  also 
consistent  with  this  conjecture. 


tabu: 
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